Approximating Markov Processes by Averaging
نویسندگان
چکیده
منابع مشابه
Approximating labelled Markov processes
Labelled Markov processes are probabilistic versions of labelled transition systems. In general, the state space of a labelled Markov process may be a continuum. In this paper, we study approximation techniques for continuous-state labelled Markov processes. We show that the collection of labelled Markov processes carries a Polish-space structure with a countable basis given by finite-state Mar...
متن کاملApproximating Labeled Markov Processes
We study approximate reasoning about continuous-state labeled Markov processes. We show how to approximate a labeled Markov process by a family of finite-state labeled Markov chains. We show that the collection of labeled Markov processes carries a Polish space structure with a countable basis given by finite state Markov chains with rational probabilities. The primary technical tools that we d...
متن کاملApproximating Labelled Markov Processes Again!
Labelled Markov processes are continuous-state fully probabilistic labelled transition systems. They can be seen as co-algebras of a suitable monad on the category of measurable space. The theory as developed so far included a treatment of bisimulation, logical characterization of bisimulation, weak bisimulation, metrics, universal domains for LMPs and approximations. Much of the theory involve...
متن کاملImmortal Branching Markov Processes: Averaging Properties and Pcr Applications by Didier Piau
The immortal branching Markov process (iBMP) is a modification of the usual branching model, in which each particle of generation n is counted, in addition to its offspring, as a member of generation n + 1, its state being unchanged. When the number of offspring is Bernoulli, iBMP accounts, for instance, for the variability of the biological sequences that are produced by polymerase chain react...
متن کاملON THE INFINITE ORDER MARKOV PROCESSES
The notion of infinite order Markov process is introduced and the Markov property of the flow of information is established.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of the ACM
سال: 2014
ISSN: 0004-5411,1557-735X
DOI: 10.1145/2537948